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(57) Abstract: A method for iden- 
tifying and quantifying information 
about molten phases, including 
slags, fluxes, metal and matte 
using a multivariate image analysis 
approach. Using this procedure, 
the properties of molten phases 
such as disruption of slag, the size 
of bare metal, partial solidification 
of slag, and temperature of slag 
can be accurately determined 
within a reasonable computation 
time. Moreover, this method 
can be implemented as an online 
measurement tool of molten phases. 
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Online Measurement of Molten Phases 



Technical Field 

The present invention is directed to identifying and quantifying 
5 information from molten phases, including slags, fluxes, metal, and 
matte. Using a method based upon principal components analysis of 
image data taken from the surface of molten phases. 

Background Art 

10 Multivariate image processing provides a reliable method for extracting 
information from image data. This method has been successfully applied 
for image processing in several applications, such as satellite image data 
and the medical area. However, there is no prior application of this 
method for online measurements of molten phases. 

15 

Availability of a reliable real time measurement of a process is an 
important factor for developing any control system. In the case of high 
temperature molten phases processing such as steel making, due to the 
extreme conditions, it is difficult and costly to carry out real time 
20 measurements. Currently, several methods for gathering information of 
molten phases, such as detection of the relative surface areas of molten 
phases and assessment of whether the phases are fully molten, rely on 
visual observations by human operators. Therefore, there is a clear need 
for more reliable online measurement of molten phases. 



WO 2004/008135 




:A2003/001053 



-2- 

An object of this invention is to delineate and quantify online 
information about molten phases within a reasonable computation time 
for detecting the relative surface areas of molten phases, determining 
whether the phases are fully molten, and predicting the temperature of 
5 the phases. Since the computation time is significantly fast, the method 
can be used as an online measurement device and integrated into a 
control system. 

Disclosure of the Invention 

10 In accordance with the invention, there is provided a method of 

characterizing molten phases using principal components analysis of 
image data taken from the surface of molten phases. The method 
developed involves (a) developing a standard and (b) using the standard 
to identify and quantify an online image data. For purpose of standard 

15 development, the procedure developed consists of the following steps: 

(i) taking a digital image of the surface of molten phases, (ii) performing 
principal component analysis of the image, and (iii) judging the 
standard values of the principal components, based on the knowledge of 
the molten phases properties, which will be used to determine the 

20 properties of online images. In using a standard to identify and quantify 
an online image data, the following steps are carried out: (a) taking a 
digital image of the surface of molten phases, (b) performing principal 
component analysis on the image, (c) comparing this analysis with 
standard values of the principal components to determine the properties 

25 of the images, and (d) quantifying the considered properties of the 
image. 
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Description of Drawings 

Figure 1 depicts a schematic diagram of the online measurement of 
molten phases. Basically, the system consists of three main parts, i.e. 
molten phases being measured, a digital camera for taking image data, 
5 and a computer for processing the image data; 

Figure 2 shows an example of an RGB image taken from molten phases; 

Figure 3 shows a schematics diagram of the principal component 
analysis procedure; 

Figure 4 depicts an example of the first two principal components plot 
10 (tj versus t>) from the image in Figure 2; 

Figure 5 is a plot correlating of predicted bare metal area, presented 
together with inert gas flowrate injected from the bottom of vessel, as a 
function of gas injection time; and 

Figure 6 is a plot correlating the temperature of the bath and the average 
15 second principal component, tj, for slag properties. 

Best Mode for Carrying Out the Invention 

A schematic dfepiction of an online measurement system of molten 
phases is generally indicated by reference numeral 20 in Figure 1 . As 
20 shown in the figure, this system 20 is applied to measuring molten 

phases in a vessel 22 and includes a digital camera 24 for taking image 
data, and a computer 26 for processing the image data. 



25 



The very first step for measuring the properties of molten phases, such 
as disruption of a slag surface, partial solidification of a slag phase, or 
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temperature of the slag, is capturing image data of the slag surface using 
the digital camera 24 in RGB (Red-Green-Blue) format The RGB 
format is a common way to represent high-resolution colour images, 
which each pixel is specified by three values — one each for the red, 
5 green, and blue (RGB) components of the pixel's colour. In a colour 
image of Figure 2, the white areas of the image correspond to bare 
metal, yellow areas correspond to thin slag, brown areas correspond to 
fluid slag, and black areas correspond to solidified slag. Such an image 
may be schematically represented as a stack of three congruent n x m 

10 . pixel images. Mathematically, the image can be viewed as a matrix, I m , 
with dimension n x m x 3, as shown in Figure 3. Such an image taken 
from the surface of a steel making ladle is visually represented in Figure 
2. Digital image data are transmitted into the process computer 26 to 
determine the properties of the molten phases based on the information 

1 5 captured by the image data. 



In processing the captured image data of molten phases, principal 
component analysis or PCA is used. PCA is a multivariate statistical 
procedure applied to a set of variables, which are highly correlated, with 
20 the purpose of revealing its principal components (or score vectors). 
The principal components are linear combinations of the original 
variables, which are independent of each other and that capture most of 
the information in the original variables into its first few principal 
components [Jackson, 1991]. 



25 
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Multivariate statistical methods, e.g. principal component analysis 
(PC A) and partial least squares (PLS), have been successfully used for 
multivariate image analysis [Esbensen et al., 1989; Geladi et al., 1989; 
Grahn et al., 1989; Bharati and MacGegor, 1998]. Using these 
5 approaches, a set of highly dimensioned and highly correlated data can 
be projected into a set of un-correlated data with a reduction in 
dimensionality. In this invention the PCA approach is used to evaluate 
the image of molten phases. 

10 For simplifying the problem, the three-way matrix I m(mxnx3) of Figure 3 is 
unfolded into an extended two-way matrix X ((n m)x3) , as illustrated in 
Figure 3. 



20 



(n x m x 3) \mn x 3) ^ 

15 The unfolded image matrix, X, is decomposed by performing principal 
component analysis [Jackson, 1991]. The relation between the original 
matrix and its principal component is given by the following equation: 



^ = S^f+£=3? )r + £ (2) 

where: X is an unfolded version of I m ; T is a score matrix; P is a loading 
matrix; and E is a residual matrix. 



WO 2004/008135 




!A2003/001053 



-6- 

By assuming that all information in the image is retained in the first two 
principal components, i.e. t x and tj, then X matrix can be approximated 
by: 




1=1 



The score vectors, t i9 are linear combinations of the variables (columns) in 
the data matrix X that explain the greatest variation in the multivariate 
data. These vectors have a property of orthogonality with respect to each 
other. Loading vectors, p i5 are the eigenvectors — in descending order — of 
the variance-covariance structure (X T X) in the data matrix. These vectors 
have a property of orthonormality with respect to each other (i.e. P T P = I; 
where I is the identity matrix). Based on the property of the score and 
loading vectors, the value of score matrix, T, can be obtained by 
multiplying X by P [Geladi et al., 1989]: • 

T=XF (4) 



10 



Following the assumption that all information in the image is retained in 
the first two principal components, the combination of the first two score 
vectors (t x and tj) would be almost identical with these pixels [Bharati and 
20 MacGregor, 1998], as shown mathematically in equation (3). Therefore, 
the combination of these principal components can be used to extract 
information from (or to discriminate materials in) the considered image. In 
addition, the average of the pixel intensities at each wavelength is 
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represented by t l5 whilst the contrast or difference among the pixel 
intensities at various wavelengths is represented by [Bharati and 
MacGregor, 1998]. In accordance with the invention, the average value 
of t x or t> may be used to characterize the property of an image, such as to 
5 determine the temperature. 



The image data from the image presented in Figure 2 was unfolded by 
using the procedure given in Figure 3 to give matrix X. Analyzing the 
principal component of matrix X using a standard procedure of PCA [e.g. 
10 Jackson, 1991] gives values of loading vector, p i5 and eigenvalues 
presented in Table 1 . All computation for this report is performed in a 
high-level computer language, i.e. MATLAB™ Version 6 and 
MATLAB™ Image Processing Toolbox Version 3 . 

Table 1. Loading vectors and eigenvalues of the image presented in 
15 Figure 3. 



Score ^ 




2 


3 


Loading 


0.7002 


-0.5738 


-0.4247 


vector 


0.6189 


0.1915 


0.7617 




0.3558 


0.7963 


' -0.4893 


Eigenvalue 


0.2458 


0.0387 


0.0081 


Total 








variance, % 


84 


13.23 


2.77 



As shown in Table 1, the cumulative of total variance of the first two 
principal components is 97.23% (84.00% and 13.23 %, respectively). 
Therefore, it is reasonable to assume that the majority of information in 



WO 2004/008135 




:A2003/001053 



-8- 

the considered imaged is retained in the first two principal components; 
the combination of these principal components can be used to extract 
information from (or to discriminate materials in) the image and then, 
only the first two principal components are used in the subsequent 
5 analyses. The loading vectors for these two principal components are 

pf =[0.70020.61890.355*1 and pj =[-0.57380.1 91 50.796^ 



A scatter plot of the first two score vectors (t x versus tj) is presented in 
Figure 4. The figure has 31 10400 score combinations plotted, one for 
10 each of the 2160 x 1440 pixel locations in the original image. It is 
interesting to note that there were several overlaps of points in the 
figure due to the large number of pixels to be plotted into the graph and 
similar features in the original image yielded similar score vector 
combination. 

15 

By projecting the values of the first two principal components (t x and tj) 
of the pixels to the corresponding image, the information in the original 
image that is explained by the combination values oft! and t> can be 
identified. The results from this process can be used to delineate the 

20 pixel class. Using the combination values of t x and t>, and combined 

with information representing an area by one pixel, the area of an object 
under consideration in the image can be determined. The results from 
this process can be used to delineate the pixel class that is given in 
Table 2. By using this approach, if the represented area of one-pixel is 

25 known, then the total area under consideration can be determined by 
multiplying the area of one-pixel with the number of points at a same 



WO 2004/008135 




:A2003/001053 



-9- 

group in Figure 4. For example, using this approach to calculate the area 
of a spout eye or bare metal area observed in the steel making ladle of in 
Figure 2 gives a value of 1 .764 m 2 . 

5 Table 2. Mapping of the first two principal components to information in 



original image. 





U 


Original Image 


1.1475 to 1.2634 


0.2995 to 0.5322 


Eye (white) 


0.6138 to 1.1475 


-0.2245 to 0.2995 


Thin slag (yellow) 


0.0790 to 0.6138 


-0.3356 to -0.1998 


Fluid slag and ladle wall 






(brown) 



Figure 5 shows an example of predicted bare metal area, presented 
together with inert gas flowrate as a function of gas injection time. As 
clearly shown in the figure, the area of bare metal is a function of inert gas 
1 5 flowrate. Clearly from the preceding discussion, the method according to 
the invention can be used to delineate the surface properties, such as 
disruption of slag or bare metal and partial solidification of slags and to 
quantify the surface attributes in term of its area. 

20 Since the second principal component, t^, represents the contrast or 
difference among the pixel intensities at various wavelengths [Bharati and 
MacGregor, 1998], the average value of the second principal component 
is used to quantify the temperature of the bath. The relationship between 
temperature and intensity will also be a function of the reflecting properties 

25 of the material, which in part is a function of ladle chemistry. 

Figure 6 shows a correlation between temperature of the bath and the 
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average second principal component, tj, for various slag grades. As shown 
in Figure 6, there is a good indication that the temperature of the bath can 
be represented by the average value of the second principal component, 
Hence, it can be concluded that the temperature of molten phases, . 
5 including slags, fluxes, metal, and matte can be determined using the 
average value of t^. 

In order to apply the image processing results as a real time measurement 
data, it is important to be able to process the image in a reasonable period 

10 of time. In the present work, the processing time for measuring the bare 
metal area is a few seconds. Therefore, it can be concluded that the 
computation speed is adequate for an online measurement system. The 
calculations were performed on an IBM™ compatible Pentium III/800 
MHz personal computer with 250 MHz RAM running in a Windows™ 

15 2000 environment and using MATLAB™ Version 6 and MATLAB™ 
. Image Processing Toolbox Version 3 . 
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Claims; 

1 . A method of identifying and quantifying information from a molten 
phase product having an exposed surface area, the method comprising the 
5 steps of 

a) developing a standard for on-line evaluation of digital images and 

b) performing said evaluation on-line, in which the standard is 
developed using the following steps: 

i) taking a digital image of an exposed surface area of a molten 
10 phase product to produce a standard image data; 

ii) performing principal component analysis on the standard 
image data to define score vectors t x and t 2 characterizing the standard 
image data; 

iii) correlating values of the score vectors t x and t 2 with 
15 characterizing properties of the molten phase product to define standard 

values of t x and t 2 ; 

and the evaluation is performed using the following steps: 

iv) taking a digital image of an exposed surface area of a molten 
phase product to produce on-line image data; 

20 v) performing principal component analysis on the on-line 

image data to define score vectors t x and t 2 characterizing the on-line image 
data; 

vi) assigning a characterizing property to areas of the on-line 
image data according to said standard values of t x and t 2 ; and 
25 viii) creating an output of said characterizing property whereby 

phases are identified and quantified; 



WO 2004/008135 




!A2003/001053 



-12- 

2. Method according to Claim 1 in which the molten phases include 
any one of the following: slag, flux, metal, matte, and glass. 

3 . Method according to Claim 1 in which the digital image is taken in 
5 the visible spectrum. 

4. Method according to Claim 1 in which the digital image consists of 
an array of pixel elements of measured intensity values in at least three 
wavelength ranges. 

10 

5. Method according to Claim 4 in which the pixel elements of the 
digital image have varying intensities of the colours red, green, and blue. 

6. Method according to Claim 1 in which the characterizing property 
15 which is corrected with the score vectors t x and t 2 is selected from the 

following group: phase identification of molten phase product; surface area 
occupied by each identified phase; temperature of each identified phase. 

7. A method of monitoring a steelmaking ladle having high 
20 temperature molten phases to discriminate between areas of the ladle 

having any bare metal, bare metal covered with slag and fluid slag, the 
method comprising the steps of: 

a) developing a standard for on-line evaluation of digital images and 

b) performing said evaluation on-line, in which the standard is 
.25 developed using the following steps: 

i) taking a digital image of an exposed surface area of a 
steelmaking ladle to produce a standard image data; 
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ii) performing principal component analysis on the standard 
image data to define score vectors t x and t 2 characterizing the standard 
image data; 

iii) correlating values of the score vectors t x and f 2 with 
5 characterizing properties of the molten phase product to define standard 

values of t x and t 2 ; 

and the evaluation is performed using the following steps: 

iv) taking a digital image of an exposed surface area of a molten 
phase product to produce on-line image data; 

10 v) performing principal component analysis on the on-line 

image data to define score vectors t x and t 2 characterizing the on-line image 
data; 

vi) assigning a characterizing property to areas of the on-line 
• ' image data according to said standard values of t x and t 2 ; and 
1 5 viii) creating an output of said characterizing property whereby 

phases are identified and quantified. 



8. Method according to Claim 7 in which the characterizing property 
which is corrected with the score vectors t x and t 2 is selected from the 
20 following group: phase identification; surface area occupied by each 
identified phase; temperature of each identified phase. 
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Figure 1. 
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Figure 2. 



WO 2004/008135 



• 



:A2003/001053 





Figure 4. 




Figure 5. 
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Figure 6. 
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